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I.  Algebraic  Multiqrid  Methods 


Work  in  the  last  four  years  on  algebraic  multigrid  (AMG)  has 
progressed  in  a  number  of  areas.  The  areas  of  application  were 
mainly  structures  and  fluid  flow,  although  there  were  advances  in 
basic  ideas  as  well.  Several  general  approaches  for  solving 
systems  of  equations  were  developed  and  applied  to  2-  and  3-d 
elasticity  equations.  [1].  Study  of  the  equations  on  "thin" 
domains  led  to  a  method  for  solving  some  badly  conditioned  problems 
[2]  by  transforming  the  equations  on  coarser  levels.  A  more 
general  approach,  called  element  interpolation,  was  developed  that 
is  more  easily  extended  to  other  problems,  and  could  be  used  in 
geometric  multigrid  methods  as  well. 


AMG  was  also  applied  to  problems  in  fluids,  such  as  linear  systems 
arising  in  flow  equations  on  unstructured  2-  and  3-d  finite  element 
meshes  [3],  and  to  Stokes  flow  [4].  A  study  of  AMG  applied  to 
time-dependent  Euler  equations  led  to  new  ideas  about  the 
application  of  AMG  to  nonsymmetric  problems,  including  a  new 
coarsening  strategy  and  a  new  view  of  the  role  of  restriction  in 
multigrid  algorithms. 


Work  has  also  been  done  in  somewhat  more  standard  multigrid 
algorithms,  guided  by  the  understanding  that  AMG  provides.  A 
robust  semicoarsenina  strategy  was  developed  and  applied  to  3-d 
diffusion  problems  in  a  heterogeneous  medium.  Although  used  in  the 
context  of  oil  reservoir  simulation  [5],  the  basic  ideas  are  useful 
in  many  areas  of  interest.  Finally,  Lagrangian  and  semi-Lagrangian 
multigrid  ideas  have  been  developed  and  tested  for  solving  time- 
dependent  2-d  incompressible  Navier-Stokes  equations  using  implicit 
time-stepping  methods.  Study  of  these  methods  in  the  context  of 
oceanography  and  meteorology  is  currently  under  way. 


II-  Multilevel  Adaptive  Methods 


The  central  focus  of  this  part  of  the  project  has  been  on  the  fast 
adaptive  composite  grid  method.  The  aim  was  its  development  as  a 
basic  methodology  for  fast  and  accurate  solution  of  a  wide  variety 
of  scientific  problems,  with  focus  on  fluid  flow  (cf.  [b]-[15])  and 
eigenvalue  problems  (cf.  [16]-[17]).  Special  emphasis  was  placed 
on  developing  this  methodology  in  the  context  of  advanced  computing 
systems,  especially  parallel  processors  (cf.  [18]-[24]).  Also,  to 
provide  the  foundation  for  these  methods,  special  finite  volume 
discretization  techniques  were  developed  that  are  very  effective 
for  maintaining  physical  conservation,  (cf.  [25]-[26]). 

To  provide  a  sound  footing  and  confidence  in  the  capability  and 
performance  characteristics  of  these  methods,  the  project  team 
developed  theoretical  foundations  for  these  discretization  and 
solution  methods  cf.  £27]— (32]) . 


Many  of  the  results  in  this  area  are  described  in  laymens  terms  in 
two  popular  articles  (i.e.,  [33]  and  [34])  and  in  detailed 
technical  terms  in  the  recent  SIAM  book  [35].  These  articles  and 
the  book  represent  progress  that  the  project  experienced  as  a 
unification  of  the  various  components  of  multilevel  adaptive 
methods,  impelled  by  substantial  progress  in  each  area  of  research: 
improvements  in  efficiency  in  multigrid  solvers,  development  of  the 
highly  effective  finite  volume  element  technique,  advances  in  the 
fast  adaptive  composite  grid  methodology,  and  development  of 
founding  theory  for  each  of  these  techniques.  This  includes: 

Mulfcigtid 

Specific  advances  in  basic  multigrid  (MG)  solvers  include  the 
development  of  a  new  scheme  for  3-D  problems  that  eliminates 
certain  inefficiencies  of  existing  schemes.  The  basic  approach 
here  was  to  develop  a  scheme  that  works  effectively  for  all  types 
of  anisotropies  of  the  differential  operator.  A  multigrid  scheme 
was  carefully  developed  and  analyzed  for  the  INTEL  iPSC  hypercube. 
This  study  was  motivated  by  the  common  concern  that  conventional 
multigrid  schemes  must  exhibit  some  parallel  processing 
inefficiency  since  coarse  grid  processing  must  lead  to  processor 
ideal  time.  The  results  of  this  study  proved  this  concern  to  be 
unfounded:  practical  use  of  parallel  multigrid  methods  would 
exhibit  negligible  processor  inefficiencies  and,  in  any  case,  these 
schemes  have  optimal  complexity  in  a  parallel  environment.  A 
related  development  is  a  precise  comparative  analysis  of  the 
complexity  of  the  Schwarz  and  multigrid  methods  in  serial  and 
parallel  computation.  Not  surprisingly,  the  analysis  established, 
in  a  limited  setting,  the  superiority  of  multigrid  for  most  cases 
of  interest.  In  other  words,  simple  domain  decomposition  schemes 
cannot  compete  with  multigrid  in  practice. 

FVE 

The  finite  volume  element  method  was  developed  by  the  project  team 
in  order  to  provide  an  efficient  and  accurate  discretization  method 
for  the  various  (uniform  and  composite)  grids  used  in  multilevel 
processing.  FVE  has  proved  to  exhibit  several  advantages, 
particularly  for  fluid  flow  applications:  conservation  is  automatic 
(in  fact,  it  exhibits  a  rigorous  sense  of  local  conservation,  even 
on  nonuniform  and  time  evolving  grids) ;  it  is  valid  at  various 
discontinuities,  including  shocks;  it  is  accurate  even  in  the 
presence  of  grid  interfaces;  it  is  founded  on  the  concept  of 
approximation  spaces,  which  is  in  contrast  to  usual  methods  based 
on  a  local  truncation  error  (which  can  be  tricky  on  nonuniform 
grids);  it  applies  in  natural  ways  for  nonlinsarities,  general 
boundary  conditions,  nonuniformities,  systems,  and  highly- 
convective  flows;  and  it  greatly  simplifies  the  design  of  MG 
constructs  (intergrid  transfers,  coarse  grid  operators,  scaling, 
and  norms) .  a  major  advance  of  the  last  project  year  was  to 
establish  a  theoretical  foundation  for  FVE.  In  fact, 
superconvergence  results  have  been  developed  for  general  diffusion 
equations  that  show  that  FVE  discretization  error  is  accurate  on 


irregular  grids.  The  estimates  obtained  for  FVE  are  better  in  some 
sense  that  the  existing  theory  for  any  other  basic  discretization 
approach,  including  finite  elements. 


FAC 

There  are  several  areas  of  recent  development  in  the  fast  adaptive 
composite  grid  (FAC)  methodology.: 

computational  fluid  dynamics  FAC  has  been  successfully  applied  to 
fluid  flow  problems  of  increasing  complexity.  To  develop  basic 
techniques,  the  initial  work  has  focused  on  potential  and  planner 
cavity  flows.  However,  work  is  now  progressing  into  Euler  and  the 
full  Navier-Stokes  equations.  One  of  the  important  aspects  of  this 
development  is  the  study  of  FAC  schemes  for  highly-convective 
(e.g.,  high  Reynolds  number)  flow. 

elliptic  grid  generation  Many  computational  fluid  flow  simulations 
involve  irregular  boundaries  and  other  phenomena  that  are  treated 
by  some  form  of  grid  generation.  Unfortunately,  grid  mapping 
schemes  tend  to  introduce  several  difficulties,  including  slow 
solvers  (of  the  grid  generation  equations  as  well  as  the  flow 
equations) ,  complicated  equations  (local  irregularities  introduce 
global  complications  in  transformed  flow  equations) ,  and  limited 
adaptive  flexibility  (grid  point  concentration  is  often  controlled 
indirectly  by  certain  "steering'*  functions)  .  MG  and  FAC  methods 
were  applied  to  elliptic  grid  generation  in  the  context  of 
potential  flow  to  overcome  these  difficulties:  MG  provides  the  fast 
solvers,  FAC  allows  for  efficiently  adapted  local  grids,  and  a 
special  version  of  FAC  allow  for  local  grid  generation  to  avoid 
global  complication  of  the  flow  equations. 

high  order  Using  a  special  hierarchical  basis  interpretation  of 
FAC  leads  to  a  simple  and  very  efficient  mechanism  for  obtaining 
fourth  and  higher  order  discretization,  without  altering  the  basic 
discretization  scheme.  Numerical  results  show  this  to  be  a  highly 
effective  scheme,  especially  since  it  continues  to  allow  local 
refinement. 

domain  decomposition  Another  interpretation  of  FAC,  as  a  domain 
decomposition  method,  was  developed  and  used  as  a  basis  for 
establishing  a  simple  theory  for  approximate  solvers. 

sel f -adaptivity  One  of  the  difficult  problems  related  to  mesh 
refinement  schemes  is  to  decide  where  and  how  much  additional 
resolution  is  needed.  Consistent  with  the  concept  of  multilevel 
schemes,  the  algorithm  developed  by  the  project  team  uses  a 
Richardson  extrapolation  of  the  error  on  different  levels  of  grids 
to  provide  an  approximation  of  the  error.  This  error  approximation 
is  then  used  to  decide  where  and  how  much  additional  refinement  is 
needed  on  the  present  grid.  This  information  is  then  used  to 
construct  patches  of  refined  grids  which  overlay  the  present  grid. 
The  work  illustrated  how  the  self-adaptive  scheme  can  be  sued  in 
both  nonlinear  problems  and  time-dependent  problems.  The  results 


for  time-dependent  problems  include  the  refinement  in  the  temporal 
direction  as  well  as  the  spatial  directions.  Again  a  Richardson 
extrapolation  is  used  to  approximate  the  error  and  this 
approximation  is  used  to  determine  both  the  time  step  on  the 
coarsest  grid  and  the  local  time  steps  on  the  patched  grids.  One 
of  the  focuses  of  this  work  is  to  demonstrate  that  FAC  (and  even 
more  so,  the  self-adaptive  FAC)  is  also  a  grid  generation  scheme. 
There  is  much  work  done  in  generating  grids  that  are  logically 
rectangular.  The  FAC  grids  (and  of  course  the  self-adaptive  FAC 
grids)  are  not  logically  rectangular,  but  FAC  includes  a  method  for 
solving  discretizations  of  partial  differential  equations  on  these 
irregular  grids.  This  allows  one  to  place  grid  patches  where  they 
are  needed  and  not  worry  about  how  much  the  grids  have  to  be 
contorted  or  stretched  to  keep  them  logically  rectangular. 

One  of  the  problems  related  to  mesh  refinement  schemes  is  the 
amount  of  work  needed  to  solve  the  problem  on  the  refinement 
meshes.  For  example,  in  all  of  the  self-adaptive  finite  element 
schemes,  when  it  is  decided  that  more  refinement  is  needed,  the 
entire  region  is  regridded  placing  additional  elements  where  they 
are  needed,  and  the  problem  is  resolved.  This  process  is  very 
expensive.  One  of  the  advantages  of  FAC  is  that  this  is  not 
necessary.  But  one  must  still  be  careful  that  the  amount  of  work 
needed  to  generate  the  grids  and  solve  on  the  resulting  grids  is 
sufficiently  small.  A  complexity  analysis  was  performed  on  both 
the  FAC  scheme  and  the  self-adaptive  algorithm  showing  that  the 
problems  can  be  gridded  and  solved  with  complexity  proportional  to 
the  total  number  of  grid  points  in  the  composite  grid.  This  work 
assumes  that  multigrid  is  used  to  solve  on  each  particular  patch 
and  shows  that  the  self-adaptive  process  does  not  raise  the  order 
of  work  necessary  to  solve  the  problem. 

time-dependent  problems  The  need  for  mesh  refinement  schemes 
becomes  more  acute  for  time-dependent  problems.  As  with  the  steady 
FAC  algorithm,  the  scheme  developed  in  the  project  allows  for 
patches  of  finer  grids  to  be  inserted  into  a  coarser  grid  and 
solves  the  problem  on  the  resulting  composite  grid.  Because  often 
in  regions  where  more  resolution  is  needed  more  temporal  resolution 
is  also  needed,  the  scheme  allows  for  local  time  stepping  on  the 
patches.  Though  the  software  developed  for  the  time-dependent  FAC 
is  general,  all  of  the  applications  run  are  for  parabolic  problems. 
In  addition,  the  project  developed  a  proof  of  convergence  for  the 
time-dependent  FAC  scheme  when  applied  to  quasi-1 inear  parabolic 
equations. 

parallel  algorithms  FAC,  like  other  local  grid  methods,  has  a  fair 
degree  of  parallelism:  separate  refinement  regions  can  be  processed 
independently  and  each  subgrid  solver  can  be  solved  by  a  highly 
parallelized  MG  scheme.  However,  in  a  very  large  scale  computing 
environment,  full  parallelism  is  hindered  by  the  sequential  way  in 
which  the  refinement  sequence  is  processed.  Asychronous  FAC  (AFAC) 
was  developed  that  allows  for  independent  processing  of  all  levels 
of  refinement,  without  degradation  in  convergence  rate.  The  full 
parallelism  and  efficiency  of  AFAC  has  been  established  in 


simulated  and  actual  parallel  computation.  These  tests  included 
incorporation  of  a  simple  by  level  load  balance  scheme  that  is 
allowed  by  the  special  A FAC  approach. 

theory 

Recent  theoretical  developments  for  FAC  and  AFAC  include 
fundamental  variational  theory  for  two-level  and  model  multilevel 
schemes,  a  nonvariational  FVE-type  theory,  and  an  analysis  of 
complexity  (including  the  case  of  a  self-adaptive  version  of  FAC)  . 


III.  Computational  Fluid  Dynamics 

The  CFD  research  has  been  aimed  at  gaining  insights  and  obtaining 
a  deeper  understanding  of  the  problems  associated  with  numerical 
solution  of  fluid  flow  problems,  and  to  developing  techniques  for 
dealing  with  these  problems.  The  main  numerical  tool  used  was 
multigrid  methods,  although  a  number  of  the  results  and  conclusions 
are  not  exclusively  related  to  multigrid.  The  problems 
investigated  were  of  incompressible  flows,  especially  at  high 
Reynolds  numbers,  and  mostly  steady  flows,  although  time-dependent 
problems  were  also  considered.  For  a  general  outline  of  our 
approach,  see  [49;Section  2]. 

The  main  results  and  conclusions  of  the  research  are  as  follows. 

1.  Even  with  the  simplification  of  considering  only 

incompressible  flows  there  are  a  number  of  problems  associated 
with  the  numerical  solution  of  the  fluid  flow  equations,  each 
of  which  requires  its  own  special  handling.  These  include 
recirculation,  boundary  layers,  singularities,  poor 

approximation  of  certain  fine-grid  components  by  the  coarse 
grids,  poor  advection  of  characteristic  components  by  scheses 
with  excessive  artificial  viscosity,  treatment  of  time- 
dependence.  In  investigating  these  problems  it  is  extremely 
important  to  separate  between  them  in  the  model  problems  as 
well  as  in  analysis.  Otherwise,  there  is  little  hope  in 
determining  the  cause  of  poor  approximation  and  of  poor 
(multigrid)  convergence  rates. 

2.  Problems  with  high-Reynolds  recirculating  flows  require 
special  considerations  in  the  discretization,  namely,  that  the 
local  truncation  errors  be  dominated  by  isotropic  viscosity 
terms.  This  is  true  even  in  problems  which  include  none  of 
the  other  difficulties  stated  above,  i.e.,  problems  with  very 
smooth  solutions,  for  which  the  local  truncations  errors  are 
vanishingly  small  compared  with  the  0(1)  solution  itself 
throughout  the  domain  of  solution.  Failure  to  comply  with 
this  rule,  e.g.,  by  attempting  to  employ  upstream  differences 
with  cell-Reynolds  numbers  that  are  too  high,  may  lead  to 
spurious  solutions  even  in  very  simple  problems,  such  as  flow 
between  concentric  rotating  cylinders,  for  which  an  exact 
solution  is  known.  See  [46]. 


3. 


In  the  context  of  shear-driven  (and)  recirculating  flows, 
where  data  propagates  from  the  boundary  into  the  interior  of 
the  domain  through  (elliptic)  viscosity  terms,  smooth 
characteristic  error  components  receive  at  most  0.5q  of  the 
required  correction  from  the  coarse  grid,  where  q  is  the  order 
of  approximation,  even  if  the  coarse-grid  problem  is  solved 
exactly.  We  have  developed  methods  for  improving  the  coarse- 
grid  correction  and  greatly  accelerating  convergence,  while 
increasing  the  total  work  by  only  a  small  fraction.  Analyses 
of  the  advection  diffusion  equation  show  that  for  first-order 
discretization  the  convergence  factor  can  be  reduced  by  these 
methods  from  0.5  to  0.11  per  two-level  cycle,  and  the  latter 
result  can  also  be  achieved  by  a  special  form  of  the  multi¬ 
level  W  cycle  for  any  number  of  levels.  These  predictions 
were  realized  experimentally  for  the  advection  diffusion 
equation,  and  convergence  rates  that  are  nearly  as  good  were 
obtained  with  the  incompressible  Navier  Stokes  equations.  See 
[55]. 

4.  Flows  that  enter  through  some  boundary,  and  whose  general 
orientation  can  be  followed,  such  as  flows  in  ducts,  introduce 
a  different  sort  of  problem  -  poor  advection  of  data  whose 
cross-stream  frequencies  are  relatively  high  on  the  scale  of 
the  grid.  The  infinite-space  analysis,  which  is  useful  in 
elliptic  problems  as  well  as  in  recirculating  flow  problems, 
is  no  longer  sufficient.  Instead,  a  half-space  analysis, 
which  brings  into  account  the  effect  of  the  inflow  boundary, 
has  been  used.  This  analysis  and  numerical  experiments  show 
that  it  is  possible  to  employ  effectively  two  different 
solution-mechanisms  within  the  usual  multigrid  process, 
resulting  in  asymptotic  convergence  rates  that  are  nearly  as 
good  as  those  obtained  for  the  Poisson  equation  (even  with 
second-order  upstream  discretization) ,  and  reduction  of  the 
algebraic  error  well  below  the  level  of  truncation  in  a  1FMG 
algorithm.  Also,  the  truncation  error  is  shown  to  be  reduced 
significantly  by  employing  ’’narrow"  upstream  schemes,  which 
also  aid  the  solution  process.  See  [51]. 

5.  The  techniques  developed  for  entering  flows  are  easily 
generalized  to  time-dependent  problems,  treating  time  as 
another  spatial  dimension  in  the  discretization.  Now  the  time 
dimension  acts  as  the  well-defined  general  orientation  of  the 
flow.  This  approach  leads  to  an  extremely  efficient  solver. 
Various  multigrid  techniques  that  have  been  developed  for 
general  time-dependent  problems  can  be  readily  incorporated 
into  this  process. 

6.  Early  calculations  with  the  Stokes  systems  have  shown  that 
performance  comparable  with  that  of  the  Poisson  solver  is 
obtainable.  Results  with  periodic  boundary  conditions  were 
matched  for  the  Dirichlet  problem  with  negligible  extra  work 
(a  single  extra  relaxation  sweep  along  the  boundaries  after 
each  full  sweep) . 
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